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ABSTRACT 

The design and architecture o£ two user-controlled, 
computer-based problem analysis environments in classical mechanics 
are discussed. In the expert-like environment, the user analyzes 
problems according to a hierarchical concept schema consistent with 
how experts analyze novel problems in physics. In the second 
environment, the user searches a data-base o£ equations using 
novice-like, surface feature keywords in order to locate the 
appropriate equation (s) to use in solving a problem. Cognitive and 
pedagogical implications o£ the research are discussed. (Author) 



* Reproductions supplied by EDRS are the best that can be made * 

* £rom the original document* * 

************ 



ERLC 



1 I * 



CO 
Osl 



Studying the 
In Physics 



OS DEPARTMENT OF EDUCATION 

Otfceol EducatK)n.t Re^arCh •n<j improvement 
EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 

©miis document has t>een reproduced as 
'eceiv^ from the person of OrganiZaliOn 
origiriating it 

□ Minor Changes have t>een made to improve 
reproduction quality 

• Points of view or opinions stated m this docu 
ment do not necessafiiy represent offiCiaJ 
OERl position 0' POtiCy 



Problem Solving Behavior of Experts 
Via Computer-flaeed Problea-Analyflis 



Jose Mestre and William Gerace 
Cognitive Processes Research Croup 
Department of Physics and Astronomy 
University of Massachusetts 
Amherst, MA 01003 



and Novices 
Bnvlroniiieacs * 



•PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) " 



ABSTRACT 



ERIC 



expert-like environment, the user analyzes problems according ?o a 



dlffer:irLn\\^s"'\"Lir' domain-specific knowledge In distinctly 

info r:ute^' cl ;.r e Lb 'l^^'^ information 

evidence of chunking (C ase I sJmJn ^SJ?*^ recall whereas novices display no 
Soloway. 1982 Urk?n 979^ \T ' ' ^ Schwartz. 1979; Ehrllch i 
forward^Jrate.l^s fewer fa^atlonr"^^ "P"' physicists us. 

(Simon i Simon 1978? M '^J"'*tlons and shorter procedures to solve problems 

experts viiX be asked to use one of tyo dj»fr,"! ""f" 

enviton.c.ts to .„al,.e probX»: lUlrl s" " her"S!Jh'?S:'a?:r''''"° 

e.per?. fo"Ml,"e""ue"s. : rtf.f :«oL°°f^^^ ""l! 



• work supported by National Science Foundation grant BNS-flsnnAo 
herein .o .ot neeesaerU, reflect the p'^aSn^'J^L^'oreiSo'lel^t'SfS" 



Jose Nescre & Ullllaffl Gerace 

DESCRIPTION OF COMPUm-UASED ANALYSIS ENVIRONMENTS 

Hierarchical Analyzer 

The Hierarchical Analyzer was designed co be conslscenc with research 
observations on expert physics problem solving behavior. When faced with a 
novel problem In which there Is no obvious course of actloni expert physicists 
first consider which basic principles applyi and then plan a solution strategy 
based on these principles. Consistent with this observation, Chi, Feltovlch 
and Glaser (1981) found that, when asked to classify problems according to 
similarity of solution^ novices use the problems* surface features whereas 
experts use the physical prlncJ^jle or law underlying the problem as the clas- 
sification criterion. These findings suggest that an expert's knowledge--score 
can be described as a dense network containing clusters of related Information 
with a hierarchical structure In which fundamental concepts occupy Che top 
levels of the hierarchy, ancillary concepts occupy the middle portions, and 
domaln*related facts and equations occupy the bottom levels of the hierarchy. 

Two additional studies Influenced the design of the Hierarchical Analyzer. 
Heller and Relf (1964) trained physics novices to generate a problem analysis 
called a theoretical problem description." Force problems In classical 
mechanics were described In terms of concepts, principles and heuristics. When 
novices were Induced to follow such descriptions, they Improved substantially 
In their ability to construct problem solutions. Control novices i who received 
good grades In a classical mc^chanlcs course, were not able to generate 
appropriate descriptions of fairly routine problems. In a similar vein, Eylon 
and Relf (1984) Investigated the effectiveness of Imposing a hierarchical 
organization on the performance of different tasks In the domain of physics. 
They found that subjects who had received a particular physics argument organ- 
ized In hierarchical form performed various recall and problem solving tasks 
better than subjects who h/:i received the same argument non-hlerarchlcally. 

The Hierarchical Analyzer was designed to guide the user through a 
hierarchical analysis of a problem In terms of both concepts and heuristics. 
The user categorizes problems In terms of those principles and heuristics that 
can be used to construct a solution to the problem. This categorization Is 
carried out by making selections from a number of menus. On any given menu- 
the selection made leads to another menu which Ic more specific than the 
previous menu, and which contains further menu selections consistent with the 
selection made on the previous menu. 

The structure of the Hierarchical Analyzer resembles a flat-^top pyramid. 
At the top of the pyramid are the four most fundamental concepts Into which we 
have chosen to partition elementary classical mechanics. These are (1) 
Newton's Second Law or Kinematics, (2) Angular Momentumt (3) Linear Momentum, 
and (4) Work and Energy. After the Initial classification, the user proceeds 
to menus containing ancillary concepts and useful heuristics, which occupy the 
middle levels of the pyramid. The menus occupying the bottom levels of the 
|iyr4l4it become Increasingly detailed until reaching the end result of the 
analysis an equatlon(s) that has been dynamically constructed In accordance 
with the classification scheme selected. 

To understand the structure and functioning of the Hierarchical Analyzer, 
It Is perhaps best to give an example. Consider the following problem: 
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A small block of mass M slides along a track 
having both curved and horizontal sections as 
shown. The track Is frlctlonless. If the 
particle Is released from rest at height h, 
what Is Its speed when It Is on the horizontal 
section of the track? 

Figure 1 contains the series of menus and menu selections which 
appropriately analyze the problem (we have placed an asterisk next to the 
appropriate choice to facilitate discussions). Several features of Figure 1 
should be noted. This problem can most easily be solved using work and energy 
principles, and thus menu Item H Is the appropriate selection. The second 
menu level Is more specific and asks the user to describe the mechanical 
energy of the system. Selection n, "Conservative system (Conservation of 
energy), Is the appropriate choice. Note the hint-: enclosed In parentheses 
to help the user decide which selection should be made. These hints guide the 
selection of choice (1) if conservative forces are present In the problem, or 
Choice U) If there are non-conservative forces present. At the third menu 
level, heuristics enter the hierarchy with the request to classify the changes 
In mechanical energy by considering one body at a time at some initial and 
final state. For the problem at hand, the block starts out with potential 
energy and ends up with only kinetic energy, so Selection n Is the correct 
one. The fourth menu level asks the user for further classification of the 
changes In kinetic energy; in this case there la only a change in 
translatlonal kinetic energy. At the fifth m-inu level, the user Is asked to 
specify the boundary conditions (or conditions at the beginning and end 
points). Menu levels six and seven parallel of levels four and five for 
potential energy. At menu level number eight, the user la asked to specify 
whether there Is more than one body In the ayatemj in this case, the answer la 
No. At menu level nine, the user Is presented with a statement describing 
the principle s/he selected at the first menu level, and a statement about how 
this basic principle applies to the particular case at hand by elaborating on 
the restrictions Imposed by the user's specific selections. 

Note that the Analyzer does not provide the answer to a problem; It Is a 
tool to aid the user In analyzing the problem. The user still must generate the 
equation that Is the answer. For Problem n, the user would have to perform 
some algebraic manipulations to obtain the correct answer, namely, vV2ih. If 
the user has made an Inappropriate selection at any menu level during the analy- 
sis, the end result would be an equatlon(s) that Is consistent with the classifi- 
cation scheme selected, b -t Inappropriate for use In solving the problem. 

Three other features of the Analyzer should be noted. The "prompt line" 
at the bottom of menu levels 1-8 allow the user to choose options such as 
backing up to the previous menu in order to change a selection, entering a 
glossary to look up the definition of a term, or listing the menu selections 
M«4i thus far. Second, if a problem lends Itself to two different correct 
analyses, the Analyzer will allow for these two correct paths through the menu 
network. Finally, ' user is given three choices at the final menu: 1) the 
problem Is solved 1* the equa:ion(s) given at the penultimate menu level are 
appropriate, 2) the user may review the equation(s) given in the penultimate 
menu level, or 3) If the problem being analyzed requires that two (or more) 
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FIGURE 1 
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different principles be applied In the analyala, the user nay return to the 
main aenu and continue. This third choice would be necessary "for example 
the block of the problem above suffered a totally Inelastic col J IsloJ wUh a 
second, stationary block on the level part of the track; In thin case 
user would need to make a second path through the Analyze. cSoo.;iog Unear 
Momentum at the first menu for the collision portion of the solution 

Formula-Centered Analyzer 

The Formula-Centered Analyzer Is Intended to emulate the problem solving 

In a number of different ways by a number of different novices. Novices 

2hJci''?-ni " 'he appropriate equation 

rMfn S ? "t^^P"^^'^^ to.yl^ld a'^swer. The most amusing evidence of 
this behavior is a typical "formula sheet" that students are allowed to take 
to physics exams - it consists of a solid mosaic of equations. Further 
novices appear to cue on a problem's surface features in deciding what ' 
equation to use. Surface feature cues take one of three possible forms: 1) 
problem types, such as "Inclined plane" and "falling bodies," 2) variable 

ene»>'«ni IT ""'^ "'^^^^'^y^ and 3) physics terms, such as "potential 
energy and momentum. 

The Formula-Centered Analyzer Is a computer-based, sortable data-base made 
up of the equations In the first fourteen chapters of the commonly used 
JiS?!^"^^*'^^''^"/"!' '••""^^^""^"tals cf Physics by Halliday and Resnick 

This equation data-base contains over 150 equations, which the user 
can reduce by performing sequential sorts according to any one of three 
criteria: Variable Name, Problem Type or Physics Term. For example, for the 
problem above, ^the user may first choose to perform a sort according to the 

"k"" n.u^^ • « of those equations containing the 

variable h. ihe user can then browse through the reduced equation list, or 
perform another sort. If the user chooses to perfora another sort, for 
example using the Problem Type "sliding bodies," the data-base would be 
further reduced. After a feu sorts, the number of equations would b- reduced 
to a small, manageable number with bpecific properties, from which the user 
can select the one or two needed to solve the problem. 



COGNITIVE AMD PtDACOClCAL RAMIFICATIONS 

The two Analyzers described above are currently being used to study the 
problem solving behavior of both novices and experts. In particular, we are 
interested In whether or not novices exhibit distinctly different patterns of 
problem categorization and problem solving proficiency after prolonged use of 
one of the two Analyzers. With experts, we are interested in observing how 
they use both Analyzers; for example, do they use the Formula-Centered 
Analyzer as a hierarchical structure by only sorting according to Physics 
Term, or do they Judiciously pick Just the right combinatior. of sorts to make 
twair path to the desired equation as efficient as possible? 

Although much is known about how experts and novices store domain-specific 
knowledge, and about how they solve problems, relatively little is known about 
the process of making the transition from novice to expert. We know that It 
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Cakes considerable time to become an expert, and chat solving large numbers of 
problems is a necessary, but not sufflcieui: condition for expertise* The work 

1 discussed in this paper is Intended to address Issues concerning the process 

; of becoming an expert. 

I 
I 

j From a cognitive perspective, it is important to begin to understand how the 

transition from novice to expert occurs, and how it can be facilitated. 
Observing novices* and experts' problem solving behavior In the problem-analysis 
environments described above may shed some light on such questions as: 1) where 
along the expert-novice continuum a particular individual lies, and 2) the 
ability to ascertait. a novice's "expert potential," or potential for becoming an 
expert in the domain in question. For example, the type of sort that an 
individual chooses to make when using the Formula-Centered Analyzer (that is, 
whether to sort only by variable name, or by physics term) may provide a good 
measure of an individual's position along the expert-novice continuum. More 
quantitative measures may be found in the l^sngth of time It takes a novice to 
adapt to the Hierarchical Analy^^er, the number of specious analyses made and the 
ability CO recognize a specious analysis. 

From a pedagogical standpoint, the Hierarchical Analyzer could also provide 
the novice with the opportunity to actively participate m problem solving 
activities, while at tne same time assimilating expert-like heuristics and 
methods for artalyzlng problems. In today's educational scenario, novices do not 
have an opportunity to observe experts engaged in problem solving activities for 
any prolonged period of time. When an expert physicist solves a problem for a 
novice, Che solution is chosen for its clarity or elegance and often bears 
little resemblance to the process that the physicist used to solve the problem. 
The iilerarchlcal Analyzer could be a cost-effective tool for providing novices 
with real expert-like problem solving experiences. 
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